Papers with scientific information extraction tasks
CitationIE: Leveraging the Citation Graph for Scientific Information Extraction (2021.acl-long)
Copied to clipboard
| Challenge: | Existing work on scientific information extraction (SciIE) considers extraction solely based on the content of an individual paper, without considering the paper’s place in the broader literature. |
| Approach: | They propose to automate the extraction of key information from scientific documents by leveraging a complementary source: the citation graph of referential links between citing and cited papers. |
| Outcome: | The proposed model improves on a set of English-language scientific documents. |
The Diminishing Returns of Masked Language Models to Science (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing studies have shown that masked language models can improve downstream tasks by pretraining larger models for longer on more data. |
| Approach: | They empirically evaluate the extent to which these results extend to tasks in science by using 14 domain-specific transformer-based masked language models. |
| Outcome: | The proposed model can improve on 12 scientific tasks, but not all. |